Biased datasets are ubiquitous and present a challenge for machine learning. For a number of categories on a dataset that are equally important but some are sparse and others are common, the learning algorithms will favor the ones with more presence. The problem of biased datasets is especially sensitive when dealing with minority people groups. How can we, from biased data, generate algorithms that treat every person equally? This work explores one way to mitigate bias using a debiasing variational autoencoder with experiments on facial expression recognition.

Existing work on fairness modeling commonly assumes that sensitive attributes for all instances are fully available, which may not be true in many real-world applications due to the high cost of acquiring sensitive information. When sensitive attributes are not disclosed or available, it is needed to manually annotate a small part of the training data to mitigate bias. However, the skewed distribution across different sensitive groups preserves the skewness of the original dataset in the annotated subset, which leads to non-optimal bias mitigation. To tackle this challenge, we propose Active Penalization Of Discrimination (APOD), an interactive framework to guide the limited annotations towards maximally eliminating the effect of algorithmic bias. The proposed APOD integrates discrimination penalization with active instance selection to efficiently utilize the limited annotation budget, and it is theoretically proved to be capable of bounding the algorithmic bias. According to the evaluation on five benchmark datasets, APOD outperforms the state-of-the-arts baseline methods under the limited annotation budget, and shows comparable performance to fully annotated bias mitigation, which demonstrates that APOD could benefit real-world applications when sensitive information is limited. The source code of the proposed method is available at: https://anonymous.4open.science/r/APOD-fairness-4C02.

When developing new technologies, we must ensure that they operate fairly. At a time when identity is increasingly being used as the key to digital access, any technology based on identity must function fairly and equally for everyone, regardless of race, age, gender, or other characteristics leading to human physical diversity. While digital services have proliferated across many industries, this issue is particularly relevant in the financial sector, as Covid-19 accelerates a shift towards automated platforms delivered remotely by banks and other providers – with biases in AI having stark implications for unfairly rewarding certain groups over others. How does AI bias creep into machine learning models? Algorithmic decision making relies on machine learning techniques that recognise patterns from historical data.